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INTRODUCTION 


The  objectives  of  our  ongoing  research  are  two-fold  [AHLJA84].  The  first  part  of  our  research 
concerns  perceptual  grouping  in  dot  textures  {Alii  J  A82.  WFRTH38].  The  goal  here  is  to  segment  a 
c’i\en  dot  pattern  into  its  perceptual  component*  i.r  .  !<■  identify  regions  and  curves  defined  In  dots 
that  coincide  vuth  the  segmentation  provided  b>  humans. 

In  the  second  part  of  our  research,  we  are  developing  a  computational  theory  for  extracting 
three-dimensional  shape  of  a  homogeneously  textured  surface  from  its  images  [STEVENS81.  WIT- 
KIN&l].  The  goal  of  the  second  part  of  the  research  is  to  separate  the  spatial  variation  in  the 
transformed  texture  into  its  two  components:  one.  characteristic  of  the  original  texture  before 
imaging,  and  the  other  introduced  by  the  distance  and  orientation  changes  in  the  imaging  process. 
Since  we  are  not  imposing  any  constraints  on  the  complexity  of  the  original  texture,  the  problem  in 
general  involves  separating  the  ambient,  homogeneous,  possibly  anisotropic,  part  of  the  texture 
from  a  smooth,  non  homogeneous,  geometric  distortion  due  to  distance  gradients  and  geometry  of 
the  textured  surface.  The  algorithm  developed  in  this  part  of  our  research  will  interface  with  the 
first  part.  We  have  worked  on  both  of  these  parts  simultaneously  during  the  year  1984-85.  Fol¬ 
lowing  is  a  summary  of  the  progress  we  have  made  during  this  year  in  each  of  the  two  areas. 

PERCEPTUAL  SEGMENTATION  OF  DOT  PATTERNS 

The  structure  of  our  current  grouping  algorithm  is  shown  in  Figure  1.  The  first  step  of  the 
algorithm  (box  A  in  figure  1)  consists  of  three  independent  modules  (boxes  II.  Bl.  and  Cl)  running 
in  parallel.  Each  of  these  modules  responds  to  a  certain  aspect  of  the  stimulus.  The  first  one  (11) 
identifies  interior  points,  the  second  one  (BI)  identifies  border  points,  and  the  third  (Cl)  identifies 
curves.  These  modules  were  developed  prior  to  1984-85.  The  second  step  (B)  corrects  possible 
errors  that  might  exist  in  the  results  of  each  of  the  three  modules  The  third  step  (C)  combines  the 
results  of  the  border  correction  (BC)  and  interior  correction  modules  (1C)  performing  a  more  global 
analysis.  Steps  B  and  C  have  been  implemented  this  year  (1984-85)  We  now  summarize  steps  B 


Interior  Border 
Combination 
(IBC) 


Curve  Correction 
(CC) 


and  C:  details  are  available  in  the  enclosed  copies  of  publications. 

To  perform  the  corrections,  first  the  results  of  the  modules  (II.  BI.  and  Cl)  are  cross  compared 
(figure  1  ).  A  module  changes  the  labels  ol  Us  input  il  doing  so  improves  the  measure  of  border 
smoothness  and  increases  agreement  with  the  results  ol  other  modules  The  results  reflect  proper¬ 
ties  ol  more  extended  spatial  context  of  dots  anil  edges  than  computed  b\  the  individual  modules. 
Once  the  correction  of  the  interior  and  border  identifications  is  completed,  then  the  necessary 
changes  are  made  and  the  correction  process  is  iterated  on  the  new  set  of  identification  until  there 
are  no  changes.  This  iteration  is  necessary  in  order  to  propagate  the  effect  of  the  label  changes  spa¬ 
tially. 

The  corrected  results  from  step  B  are  combined  with  the  aid  of  assumptions  about  more  global 
properties  such  as  closure  of  borders.  To  do  this,  first  the  borders  around  the  points  labeled  as  inte¬ 
rior  by  the  module  1C  are  identified.  This  results  in  border  segments  around  interior  regions.  Then, 
the  intersection  of  these  identifications  and  the  results  of  the  module  BC  is  taken.  This  results  in 
those  Delaunay  edges-being  identified  as  border  that  have  confirmation  from  two  independent 
processes.  The  result  is  a  set  of  border  segments  and  a  set  of  interior  points  next  to  them.  A  con¬ 
nected  component  analysis  is  carried  out  on  the  regions  surrounded  or  separated  by  the  border  seg¬ 
ments  (step  C).  If  a  set  of  border  segments  defines  a  closed  curve,  no  further  processing  is  done  on 
that  region.  If  the  border  is  not  closed,  then  the  process  attempts  to  extend  it  with  the  eventual 
goal  of  closing  il  and.  at  the  same  time,  ensuring  that  the  border  segment  being  extended  is  smooth. 
After  the  border  completion  is  accomplished  the  borders  are  smoothed  by  performing  single  point 
changes  in  which  the  border  grabs  a  single  point  either  from  the  interior  or  the  exterior  if  it  makes 
the  border  smoother.  A  component  interaction  module  then  checks  (step  D)  if  any  two  components 
can  be  merged  together,  thus  making  the  border  smoother  without  altering  the  interior  properties 


of  the  components. 


SURFACE  SHAPE  FROM  TEXTURE 

Texture  variations  provide  strong  cues  for  the  three  dimensional  arrangement  and  structure 
ol  the  surfaces  \  isible  in  an  image.  Two  types  ol  distortions  occur  during  the  imaging  process: 
increasing!-,  laree  areas  ol  surlace  are  compressed  onh  a  lixed  area  ol  the  image  as  the  textured 
surlaee  recedes  aw  a  .  I  roni  the  Ci-  wer.  and  an  anisotropy  compression  ol  the  texture  elements  due 
to  foreshortening  occurs  as  the  surface  tilts  away  from  the  frontal  plane.  We  have  investigated 
.iow'  to  exploit  textural  cues  to  infer  the  relative  distance  and  orientation  of  the  textured  surfaces 
depicted  in  an  image  We  have  looked  for  methods  that  would  work  on  images  of  natural  (as 
opposed  to  human-made)  textures,  that  handle  sub-  and  super-texture  appropriately,  and  that  do 
not  rely  on  specific  texture  models.  W’e  do  not  address  the  texture  segmentaiion/discriminalion 
problem,  assuming  that  it  is  known  which  parts  of  the  image  correspond  to  different  homogene¬ 
ously  textured  3D  surfaces. 

We  have  found  that  a  “scale-space"  representation,  which  represents  V2G  image  properties 
over  a  continuous  range  of  scales,  is  useful  for  identifying  textural  features  of  all  different  sizes. 
W’e  have  derived  measurements  that  can  be  performed  in  a  V2G  scale-space  in  order  to  characterize 
the  size  of  texture  elements  without  know  ledge  of  the  actual  shape  of  the  texture  elements.  The 
equations  for  the  measurements  are  derived  by  mathematical  analysis  of  the  V2G  and  _i-V2C> 

responses  to  images  consisting  of  ideal  bars  and  disks.  The  V2(’>  response  to  more  complex  images 
cannot  be  analyzed  in  this  wav  because  the  convolution  integrals  do  not  have  closed  form  solutions 
Nevertheless,  it  can  be  hoped  that,  due  to  the  smoothing  properties  of  the  Gaussian,  the  V2G 
response  to  components  of  real  textural  primitives  will  be  similar  to  the  response  expected  for  pat¬ 
terns  of  idealized  bars  and  disks.  Tests  on  real  images  bear  out  this  hope.  We  have  worked  mainly 
with  the  image  shown  in  figure  2. 

Our  method  models  texture  elements  with  equivalent  disks  by  identifying  the  size  and  loca¬ 
tion  of  circular  disks  which  best  fit  the  scale-space  behavior  of  the  texiure  sample  in  question  (We 
can  compute  the  diameter  of  a  disk.  The  location  of  disk  centers  is  approximated  by  local  maxima 
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Figure  2.  An  image  of  a  surface  with  rocks.  This  image  is  being  used  to  develop  our  shape  from  tex¬ 
ture  algorithms. 


in  the  V2G  response.)  Elongated  texture  elements  appear  as  chains  of  disks:  this  representation  is 


reminiscent  of  the  medial  axis  transform. 
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ABSTRACT 

This  paper  describes  aa  approach  to  structural  segmentation  of 
dot  patterns  such  that  the  results  are  in  agreement  with  segmenta¬ 
tion  performed  by  humans.  Vorooai  neighborhoods  are  used  to 
represent  the  geometric  structure  in  the  dot  pattern.  A  st  of 
experts  then,  m  parallel  look  for  structural  components  such  as 
borders,  interiors,  and  curve*.  The  experts  have  their  expense 
expreasd  in  terms  of  the  properties  of  and  interaction  among  Voro- 
ooi  neighborhoods  The  interaction  is  accomplished  through  a 
relaxation,  constraint-propagation  procam.  The  raaulta  of  them 
experts  have  errors  due  to  the  lack  of  local  evidence  for  the  global 
role  of  a  dot.  Each  mult  then  is  corrected  such  that  1)  it  agraea 
with  the  results  of  other  experts  and  2)  it  provides  locally  smooch 
borders  Except  for  occasional  gaps  m  the  borders  the  umoo  of  the 
corrected  multi  represents  a  good  approximation  to  the  perceptual 
structure  in  the  dot  pattern.  Connected  component  analysis  is  ear¬ 
ned  out  to  identify  them  gaps  The  gape  are  filled  to  clam  the  com¬ 
ponent  contours  ensuring  local  border  smnmhnmi 

~  1.  INTRODUCTION 

Dot  patterns  have  bera  studied  in  the  pest  in  different  con¬ 
texts  including  human  perception  [8. 14. 17]  and  aa  simpler  cams  of 
muludunensKmal  clustering  algorithms  [2.  4,  6.  12. 181  In  the  con¬ 
text  of  visual  psychophysics  dor  patterns  provide  a  set  of  stimuli 
whose  spatial  properties  can  be  controlled  precisely.  Dote  can  be 
regarded  as  tokens  whose  shapes  sum  in  tensities  colors  etc  are 
kept  constant  and  wham  mam  important  propertias  art  their  poo- 
tions  Hence,  they  form  an  ideal  set  of  aumuU  to  study  the  effaces 
of  only  the  spaual  distribution  of  tokens  in  grouping  proem*  m  a 
tractable  fashion.  The  simplicity  of  the  stimulus  may  help  probe 
selected  parts  of  the  early  vision  in  humans  and  gain  mat  under¬ 
standing  about  the  procemm  premnt  here. 

One  of  the  moat  important  aspects  of  tarty  human  vlaon  is 
that  it  unpoam  a  structure  onto  the  stimulus  in  the  form  of  percep¬ 
tual  grouping.  It  identifies  elements  in  the  visual  field  that  in  some 
sense  "go  together.’  This  phenomenon  was  first  pointed  out  by  the 
Gestalt  psychologists  [29]  and  has  important  consequences  First,  it 
improves  the  efficiency  of  the  procam  of  parsing  the  visual  field  into 
surfaces  and  objects  and  m  the  recognition  of  thorn  objects  by 
reducing  the  amount  of  data  these  procemm  must  handle  Second,  it 
might  result  in  percepts  that  do  not  exist  to  the  objective  data  but 
are  introduced  is  a  result  of  the  internal  biasm  of  the  system  itself. 
Thus,  grouping  together  the  broken  edge  mgmeots  from  an  edge 
detector,  would  result  in  on*  long  border  of  a  region  which  no  edge 
detector  working  on  an  intensity  image  could  produce  because  of 
the  intensity  distribution.  An  understanding  of  bow  this  grouping 
■s  accomplished  and  what  kinds  of  rulm  govern  it  will  probably 
incroMe  our  understanding  of  how  the  early  human  visual  system 
is  structured. 

Thu  were  was  mppenaS  h  the  Air  Fora  Otoe  ot  Sewnnie  learn  unwr 
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This  paper  will  prmant  an  algorithm  to  extract  groupings  in 
dot  patterns  and  the  resulting  spatial  structural  Section  2  will 
review  briefly  past  rasmrch  efforts  in  this  field.  Section  3  will 
praeant  the  algorithm  for  grouping.  Finally.  Section  4  will  premnt 
mm*  concluding  remark* 

2.  REVIEW 

The  research  on  dm  patterns  and  grouping  ci  dot  patterns  has 
been  conducted  in  fields  including  psychology  and  computer  sci¬ 
ence.  Perceptual  structure  in  both  dynamic  and  static  dot  patterns 
has  been  studied. 

In  the  perception  of  static  dot  pattern*  different  properties 
relevant  to  grouping!  of  elements  in  the  visual  field  such  aa  spacing 
o f  elements  were  studied  by  Urtal  st  al  [261  Pomerann  and 
Schwaittberg  [I9i  Julaar  [10.  Ill  The  detectability  of  dotted  Unas 
in  a  noisy  background  arae  studied  by  Uttal  st  al  [26]  and  the 
importance  of  dot  spacing  in  this  datactabiUty  eras  shown.  The  sca- 
tisucal  propartsea  of  dot  pattern*  their  local  spatial  properties  such 
sa  e  umber  of  termination*  etc.  and  the  importance  of  them  proper  - 
Urn  in  the  diacnmipahtUty  of  textures  (id  ill 

la  computer  mience  the  work  on  dot  patterns  n  divided  into 
two  me  nr  arose  l)  defining  the  neighbors  of  a  dot.  and  2) 
clustering  algorithm*  The  roemrch  in  «ch  of  thmc  anas  will  be 
riimiiamd  next. 

The  crucial  information  that  is  used  by  perceptual  processes 
that  perform  the  grouping  of  the  dot*  into  ’meaningful’  clusters  a 
the  spatial  relationship  that  a  dot  has  with  its  ’neighbor*’  Hence, 
the  concept  of  ’neighbor'  and  the  concept  of  the  ’neighborhood*  of 
a  dot  are  of  crucial  importance  to  the  theory  of  perceptual  grouping 
procemm  In  the  past,  theta  has  been  a  number  of  definitions  of 
neighbor. 

A  fixed  circular  neighborhood  of  a  dot  with  a  globally  defined 
radius  R  is  ueml  by  Koootz  [12]  and  Patrick  and  Shea  [lSl  Thecoo- 
cept  of  k-omnm  neighbor!  of  a  pout  has  been  used  by  Zuckcr  and 
Hummel  [31 1  Velaaco  (271  and  Jarvis  and  Patrick  (Si  Both  of  them 
have  the  disadvantage  of  being  very  inflexible. 

O'CalUghan  [16]  gives  a  definition  of  neighbor  baaed  on  both 
distances  and  angle*  la  ha  definition  two  pouts  may  be  within 
the  right  nag*  of  distance  to  be  considered  neighbor*  but  if  they 
are  “hidden’  from  each  other  by  a  third  pout  they  are  not  con- 
sderad  to  be  neighbor* 

Other  definitions  of  neighbor  include  the  minimum  spanning 
tree  (MST)  (Ml  Gabriel  graphs  (GG)  [21]  and  the  relative  neighbor¬ 
hood  graphs  (RNG)  [22,  231  Abu*  (l ]  suggests  the  use  of  Voroaoi 
neighborhoods  (2Sl  which  have  more  intuitively  appealing  proper- 
urn  than  the  previous  definition*  u  the  procemng  of  dot  pattens* 

Early  clustering  algorithms  used  venous  entena  based  oo 
pirorm  amilamy  matrons  of  dots  u  order  to  measure  goodnms  of 
clustering  [4,  9,  !2l  Them  similarity  m assures  were  based  on  the 


2. 


store  traditional  ditiiuoai  of  neighbors  rf  i  dot.  Graph* 
theoretical  approach*  have  ban  uwd  m  order  to  mgmni  a  dot  pat¬ 
tern  into  clueten  (6,  7.  23.  30l  Several  asthods  have  ben 
developed  which,  for  two-diaeaaooal  pettena  bee*  their  aaeaure 
of  nmilanry  oo  neighbors  of  potato  taking  iata  cooadentioa  local 
geotnetnc  rtructun  of  the  poiat  diom button  [6-4.  14. 13. 17. 23-131 
Some  raeoarchera  have  uaad  algorithms  [23,  24]  which  ate  formu¬ 
la  tad  in  a  relaxation  labeling  reheat  [201  thue  mating  it  uaaaccr- 
sery  to  uat  thneholda  A  oonadentioo  of  the  human  vuual  system, 
ita  iumpirmt  about  the  physical  world,  its  hi  am  namely  the  gae- 
talt  principles  of  the  way  patterns  are  perceived  by  humans  was 
lacking  in  tnoet  of  thaw  works  with  mat  exceptions  [3, 13-13. 171 
In  some  of  the  work  restrictions  were  made  about  the  kinds  of  pat¬ 
terns  that  the  algorithm  eras  supposed  to  work  on.  Some  of  them 
reetncuons  wen  that  the  patterns  would  contain  only  uniform 
clusters  [14.  13.  17.  231  or  that  they  would  contain  only  varying 
density  clusters  [24]  or  only  curvilinear  clusters  [3, 13l  We  now  go 
on  to  deem  be  the  grouping  algorithm  in  the  next  action. 

3.  GROUPING  ALGORITHM 

The  algorithm  to  be  described  in  this  paper  fa  performing 
grouping  of  dot  patterns  is  based  on  the  Vosonoi  taatllatioo  of  dot 
patterns  and  the  geometrical  properties  of  the  Voroooi  polygons, 
that  are  the  outcome  of  this  tesmllatioo.  That  geometrical  proper  - 
taa  reflect  information  about  the  spatial  distribution  of  dm  in  the 
neighborhood  of  a  given  doc 

The  current  system  is  designed  to  work  in  two  major  phases. 
The  first  phase  taka  the  dot  pattern  a  in  input  and  produce*  the 
lowest  level  groupings.  The  second  pfaaa  starts  with  the  output 
groupings  produced  by  the  first  phaw  and  produces  the  hierarchical 
structure  of  these  groups  of  dots  (if  any  c lists)  in  a  recursive 
manner.  The  following  section  will  deem  be  the  details  of  the  first 
phase. 

3.1.  The  First  Phase  of  Segmentation 

The  first  phase  of  the  segmentation  mentioned  above  works  us 
-  three  sups.  The  general  structure  of  this  phase,  its  modula  and 
their  interconnections  are  shown  in  figure  1.  The  first  step  (box  A 
in  figure  l)  consists  of  three  independent  modula  (bo see  0.  BL  and 
Cl)  running  in  parallel.  Each  of  them  modula  responds  to  a  certain 
aspect  of  the  stimulus.  The  first  one  (ID  idenufia  Ulterior  points, 
the  second  one  (BI)  identifia  border  pointk  and  the  third  one  (CD 
identifies  curves.  The  second  step  (B)  corrects  poaible  errors  that 
ought  exist  in  the  result  of  each  of  the  three  modules.  The  third 
step  (C)  combines  the  results  of  the  border  correction  (BC)  and  inte¬ 
rior  correction  modula  (1C)  performing  t  more  global  analysis. 
The  outputs  of  all  tbae  modula  obtained  for  the  sample  pattern  in 
figure  3  are  shown  in  figures  6-1 1. 

Before  going  into  any  further  details  of  the  system  that  does 
the  grouping,  we  will  ducua  the  properua  of  the  Voronoi 
polygons  in  the  teswllauon  uad  by  the  system  to  perform  the  vari¬ 
ous  groupings.  There  are  a  number  of  measures  that  are  computed 
reflecting  the  geometric  properua  of  the  spatial  distnbutioo  of  dots. 
Each  of  tbew  measures  and  ia  significance  are  described  below.  In 
ibis  paper  we  will  via  the  terms  polygon  and  cell,  the  region  sur¬ 
rounded  by  tbe  polygon,  interchangeably. 

The  first  property  is  the  area  of  the  Voronoi  neighborhood  of 
a  dot.  Thu  u  a  measure  reflecting  information  about  the  dot  den¬ 
sity  ui  the  neighborhood  of  a  dot.  In  the  interiors  of  homogeneous 
clusters,  the  density  does  not  change.  Recalling  the  way  the  Voro¬ 
noi  teswllauon  is  constructed,  we  observe  that  this  uniformity  of 
density  will  result  in  tbe  Voronoi  neighborhood  being  uniform  m 
area  in  tbe  interior  regions. 

The  second  property  is  tbe  eccentricity  of  the  Voronoi 
polygons.  Thu  measure  u  a  scaled  vector  indicating  how  much  a 
dot  u  off  the  center  of  gravity  of  iu  Voronoi  polygon.  The 
significance  of  the  eccentricity  measure  vs  that  it  is  related  to  the 
change  of  density  of  dots.  The  in  tenon  of  uniform  dusters  are 


Figure  1  —  The  modula  and  their  interconnections  that  make  up 
this  system. 


expected  to  have  cells  with  very  low  eccentnciuee  because  of  the 
lack  of  variation  in  the  density.  The  in  tenors  of  varying  denary 
clusters  will  have  cells  with  high  eccentnciua  due  to  the  density 
variation;  the  directions  of  the  eccentnau*  will  be  pouting 
toward*  the  incraasug  density  direction.  Thus,  the  eccentricity 
vectors  of  the  cells  in  the  interiors  of  varying  density  clusters  will 
be  aligned  moat  of  the  time.  At  the  borders  of  cluster*,  the  eccen¬ 
tricity  directions  in  most  cases,  will  be  expected  to  point  towards 
the  in  tenon  of  the  clusters  becauss  of  the  sudden  increase  in  tbe 
dot  density;  ut,  from  the  very  low  density  in  the  intercluster  space 
to  the  comparatively  high  density  in  the  intenor  of  the  cluster. 
Thu  ofawrvauon  also  bolds  on  the  borders  of  ban  which  are  c  lus¬ 
ters  without  interior  points. 

The  third  property.  Gabriel  measure,  measures  the  'neighbor- 
line*'  of  two  Voronoi  neighbors.  If  the  line  joining  two  Voroooi 
neighbors  i  and  j  intersects  the  edge  shared  by  the  corresponding 
Voronoi  polygons  then  i  and  j  are  perfect  neighbors.  Thai  is.  there 
u  no  third  point  k ,  such  that  the  point  i  u  hidden  from  the  point 
y  by  the  point  k .  and  vice  vena.  If.  on  the  other  band,  then  u 
such  a  third  point  k  ,  and  the  line  (i  .; )  etnas  the  Voronoi  cell  for 
point  k ,  then  i  u  hidden  from  ;  by  *  and  the  Gabnel  measure 
indicates  the  amount  by  which  ibu  u  true.  The  deeper  the  line 
(i  ./  )  draws  cell  k  .  the  worse  neighbon  (i  ,y  )  are  and  the  lower  tbe 
Gabnel  measure  is.  Thu  is  important  on  the  borders  of  dusters, 
where  if  the  two  points  are  not  perfect  neighbon  and  have  a  low 
Gabnel  measure,  then  the  border  follows  through  the  intervening 
point  instead  of  the  two  points. 

Tbe  fourth  measure  computed  is  the  compactness  measure. 
Thu  u  a  measure  indicating  how  wedge  shaped  the  Voronoi  neigh¬ 
borhood  of  a  dot  ia  These  types  of  cells  art  sees  at  points  where 
the  borders  of  two  clusters  gradually  approach  each  other.  Tbe 
wedge-like  shape  of  the  cells  is  caused  by  ipe  non  uniform  distnbu- 
uon  of  the  neighbon  of  a  point  around  it.  and  the  wedge-tike 
shapes  of  the  polygons  indicate  that  the  points  are  possibly  on  the 
border  of  a  cluster. 
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Figure  2  —  The  distinct  measure  for  the  Delaunay  edge  (i  ,j X 
dm, ; ,  is  defined  in  terns  of  the  length  of  the  Delaunay  edge  (t .)  X 
d .  and  the  average  Delaunay  edge  lengths  on  its  two  endpoints. 
dav,  and  dav  r  Let  D  “min  (dav,  Aav , X  Then  dist,lml—D/d  if 
d  >D.  and  dist,t  *0  otherwise. 
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Figure  3  —  Squeezed  new  measure,  sq,,,  is  defined  in  terns  of  the 
length  of  the  Delaunay  edge  (i ./  X  d .  and  the  average  Delaunay 
edge  lengths  on  its  two  sides  laterally,  dav ,  and  dav  ?  Let 
D  *min (dav ,jiav2l  Then  sqn*l—d/D  if  d  <D.  and  rg,,  ■ 0 
otherwise. 


The  fifth  measure  is  a  distance  measure  defined  for  i 
Delaunay  edge.  It  measures  the  change  in  the  distance  between  two 
dou  compand  to  their  surroundings.  The  computation  of  this 
measure  is  shown  in  figure  2.  This  measure  is  useful  manly  m  the 
regions  containing  curvilinear  clusters  or  Jingle- point  clusters, 
because  around  such  clusters,  measures  such  as  areas,  eccentricities, 
etc.  an  very  unreliable.  Distance,  and  GatmeL  and  aquaeztdnam  (to 
be  described  below)  measuree  an  mostly  the  only  ones  uaed  to 
describe  these  contexts.  Of  course,  if  the  dusters  an  well  separated, 
this  measure  is  also  helpful  for  identifying  edges  between  clusters 
with  interiors. 

The  lath  measure  computed  is  the  elongations  of  the  Voronot 
cells  and  the  directions  of  their  minor  Lies  When  then  is  a  duster 
in  a  pattern  where  the  density  of  dou  is  uniform  but  direction  rnn- 
titive  (ue.  the  density  in  one  direction  is  different  from  that  in 
another  direction)  the  Voronoi  polygons  tend  to  be  elongated.  The 
dmctioa  of  the  minor  axis  tends  to  be  aligned  with  the  higher  den¬ 
sity  direction.  As  the  disparity  of  the  densities  in  taro  directions 
increase*  the  Voronoi  cells  become  more  elongated.  This  measure  is 
computed  using  the  sacond  order  moments  of  area  of  a  celL 


Another  measure,  squsersdnsm,  is  computed  which  a  eery 
closely  related  to  the  s long* tun.  but  it  is  a  property  of  the 
Delaunay  tdgea  rather  than  Voronoi  polygon*  and  it  is  bMd  upon 
the  of  the  murounding  Delaunay  edge*  la  compilation  is 

shown  in  figure  3.  This  measure,  similar  to  the  distance  measure,  is 
mostly  useful  around  curvilinear  cluster*  Neatly,  the  Delaunay 
edges  that  lie  on  a  curvilinear  cluster  an  expected  to  be  shorter 
compared  to  the  Delaunay  edges  extending  on  the  two  sides  of  the 
curve  laterally. 

3.1.1.  Interior  Identification 

The  intenor  identification  ts  formulated  in  a  probabilistic 
relaxation  scheme  with  the  dou  being  labeled  at  either  INTERIOR 
or  NONINTERIOR.  This  formulation  is  baud  upon  the  local 
geometrical  properties  of  the  Voronoi  polygons  resulting  from  the 
Voronoi  tsmellatun. 

The  main  task  is  to  formulate  the  local  compatibilities 
between  pain  of  doc*  This  formulation  is  baaed  on  the  asnimption 
that  certain  property  of  the  polygons  will  be  true  for  the  interior 
point*  Specifically,  in  the  interiors  of  homogeneous  clusters,  the 
irtai  of  Voronoi  polygons  will  be  approximately  the  same  and  the 
eccentric)  tiae  of  the  cells  will  be  low.  In  the  interiors  of  nonhomo- 
geneous  clusters  the  eccentricity  trill  be  high  but  they  will  be 
put ii ting  is  the  sum  dinction.  namely,  in  the  increasing  density 
direction.  These  fact*  used  conservatively,  trill  remit  in  the  mast 
obvious  interior  poinu  being  identified. 

The  compatibilities  an  defined  for  the  four  pambte  combina¬ 
tions  of  labeling  two  poinu  as  INTERIOR  or  NONINTERIOR.  In 
order  to  define  thaw  oompntibilitiae  one  has  to  consider  all  the  oomi- 
hle  cases  of  combinations  and  in  what  contexts  they  can  occur.  In 
this  case  all  the  poanble  contexts  m  which  interior  and  nountenor 
combinations  can  occur  an  shown  in  figure  *  For  each  of  than 
cans  u  eiprtaeion  is  written  which  measures  how  compatible  the 
label  combination  for  two  poinu  is  in  tbs  given  context.  For  exam¬ 
ple.  for  the  case  shown  in  figure  4  a).  ana  erould  have  the  expns- 
aoo  minCl-ecCpl-eoc^l-AA^X  In  this  eiprmnnn  sec  end  etc  an  the 
eccentricity  magnitudee  for  the  Voronoi  polygons  of  the  cells  of 
dou  i  and  i  respectively.  AA  is  the  arm  difference  of  the  two 
polygons  normalized  to  the  range  [0.1]  and  is  defined  as  sbdA  - 
Aj/maxfA^Aji  In  this  case  A,  and  A  ire  the  anas  of  the  polygons 
for  the  dou  i  and  >  respectively.  The  intuitive  meaning  of  the 
expreanon  is  that  in  the  interior  of  a  homogeneous  clusters  the 
eccentricity  magnitudes  and  the  ana  differences  an  expactad  to  be 
small.  If  that  is  the  case  with  the  two  dot*  the  above  expmnon 
will  have  a  high  value  and  will  have  a  pontive  contribution  to  the 
INTERIOR-INTERIOR  compatibility  value.  After  the  expressions 
for  all  these  cues  have  been  derived,  for  a  particular  combination 
of  label*  the  ex  proems  for  *11  its  cases  an  combined  by  a  fuzzy 
OR  operation.  That  i*  for  two  points  i  and  j  to  be  compeuble  with 
labels  INTERIOR-INTERIOR,  they  must  have  the  context  shown  in 
case  (sX  or  east  (bX  of  figure  4.  Similarly,  for  other  combinations  of 
labels  for  the  two  point*  the  expresuons  for  different  casts  an  com¬ 
bined  to  get  the  compatibility  expressions. 

Once  (beat  compatibilities  an  defined,  the  relaxation  labeling 
scheme  is  run  which  results  in  the  assignment  of  probabilities  to 
each  point  of  having  a  certain  label  (step  A.  module  0  in  figure  1). 
Mon  of  these  probability  converge  to  either  very  high  or  very  low 
values  resulting  in  unambiguous  labelings  (tveo  though  they  may 
be  the  wrong  labelsX  The  few  points  with  mon  ambiguous  proba¬ 
bility  an  assigned  the  label  with  the  stronger  probability.  If  this 
turns  out  to  be  the  wrong  label  it  is  hoped  that  the  later  phases 
will  correct  this  taking  into  cons  deration  a  larger  context  (step  B  in 
figurt  1 X  information  coming  from  other. modules  independently, 
and  Gestalt  amimptions  such  as  border  smoothnea  (steps  B  and  C). 
and  closure  (sup  CX  These  corrections  an  performed  when  the 
results  of  the  three  module  an  being  [uniimil  for  poatblc  correc¬ 
tions  and  merges  (sups  B  and  C  in  figurt  l ). 
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Figure  4  —  The  poaable  coauru  in  which  INTERIOR  end  NON¬ 
INTERIOR  compatibilities  *re  computed. 


3.U  Border  end  Carre  Identification 

The  method  of  identification  of  borden  and  curvee  is  tutu  Ur 
to  the  identification  of  the  interior  potnu.  In  this  case  the  objacts  to 
be  labeled  are  the  Delaunay  edges.  They  are  labeled  as  either 
BORDER  or  NONBORDER  in  the  border  identification  module  and 
CURVE  or  NONCURVE  in  the  curve  identification  module. 

The  compatibilities  in  these  modules  are  also  formuUtad  by 
looking  at  all  the  ptanble  contain  and  identifying  the  different 
cases  and  formuUting  the  constraints  between  properties  of  the 
cells  and  edges  that  must  hold.  The  posable  contexts  for  theae  cases 
are  identified  similar  to  the  interior  identification  proems.  The 
cxpremiana  for  each  of  that  cases  are  identified  baaed  on  them  con¬ 
texts  and  combined  to  get  the  final  compatihility  relations. 

3. 1-3.  Label  Corrections 

As  a  result  of  the  previous  step  (step  A  in  figure  li  the  dots 
and  the  Delaunay  edges  are  labelled  as  INTERIOR-NONINTERIOR. 
BORDER-NONBORDER,  or  CURVE-NONCURVE.  Soma  of  them 
labels  may  not  be  correct  due  to  lack  of  local  evidence,  ambiguities, 
etc  Theae  incorrect  Ubels  need  to  be  corrected  by  using  informa¬ 
tion  from  a  larger  context.  The  results  of  the  modules  (D.  BE  and 
Cl)  and  the  agreement  among  them  rwults  is  uskI  to  obtain  the 
information  from  the  larger  context.  The  criterion  that  harden  be 
smooth  is  also  used  to  decide  whether  a  labeling  of  a  dot  or  a 
Delaunay  edge  needs  to  be  corrected.  The  context  that  is  considered 
is  larger  because  the  border  segment  necaatary  for  computing 
smoo times  or  the  agreement  meuure  poenbly  extends  beyond  the 
neighborhood  of  the  object  being  considered  for  correction. 

This  sup  consists  of  three  modules  (1C  BC  and  CC  in  figure 
l).  Each  one  corrects  one  set  of  identifications  from  the  previous 
sup  concurrently  and  independently  using  the  information  from 
the  previous  sup  as  shown  in  figure  1.  A  module  changes  the  labels 
of  its  input  if  doing  so  improves  the  measure  of  border  smooths em 
and  increases  agreement  with  the  reaulu  of  other  modules  The 
correction  proems  is  formulated  in  a  probabilistic  relaxation  scheme 
with  the  labels  I  CHANGE.  NO-CHANGE  I  on  the  objKts  The 
objects  are  the  dm*  for  the  correction  of  dot  labels,  and  the 
Delaunay  edge*  for  the  correction  of  border  identifications  How¬ 
ever.  not  all  of  the  dou  or  the  Delaunay  edges  are  conadcred  for 
correction.  The  most  confident  oow  (U.  the  dou  or  Delaunay  edges 
whose  identifications  from  the  two  independent  mod u la  Q  and  B! 
are  ua  agreement!  are  omitted.  Only  the  object*  whose 
identifications  from  the  two  independent  modules  conflict  are  con¬ 
sidered  for  correction.  This  increases  the  efficiency  of  the  correction 


Figure  3  —  A  ample  dot  pattern  to  be  segmented. 


procan  An  example  of  computing  compatibilities  ru  for  objects  i 
and  j  mu  follows 
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In  this  expramion,  curv  stands  for  the  value  of  the  curvature  of  a 
border  segment.  The  border  segment  whom  curvature  is  computed 
depends  on  the  identification  of  the  obpet  being  labelled.  For 
example,  if  the  objKt  is  a  dot  that  is  identified  u  interior,  then  the 
border  segment  around  the  pout  is  considered  for  curvature  com¬ 
putation.  Note  that  if  the  inunor  point  n  surrounded  by  all  inte¬ 
rior  potnu  and  dou  not  have  a  border  pawing  by  it.  then  it  has  s 
confident  identification  and  will  not  be  considered  for  correction  to 
begin  with.  If  the  dot  is  identified  as  border  then  the  border  seg¬ 
ment  going  through  the  dot  is  considered  for  curvature  computa¬ 
tion.  In  each  of  these  cases  a  small  portion  of  the  border  segment  is 
considered,  for  example,  a  segment  of  five  dots.  The  expreanoo  agr 
it  a  measure  of  the  agreement  of  the  raults  of  the  two  independent 
modules.  Therefore,  this  computation  reflects  the  expectation  that 
the  curvatures  of  borders  around  the  objects  i  and  j  be 
(U.  the  borders  be  smooth)  and  the  agreements  of  reeults  between 
different  modules  be  high. 

Once  the  correction  of  the  in  tenor  and  border  identifications  is 
completed,  then  the  nee— ary  changes  are  made  and  the  correction 
proceu  dumbed  above  is  iterated  on  the  new  set  of  identifications. 
This  iterauon  is  necessary  ua  order  to  propagate  the  effect  of  the 
newly  changed  labels  This  iterauon  proceeds  until  there  are  no 
more  label  changes  Them  corrected  reaulu  are  then  combined  to 
get  a  final  ugmenuuon  in  the  next  stepi 

3U  Combining  the  Reaulu 

The  corrected  reaulu  from  step  B  are  combined  with  the  aid 
of  assumption]  about  more  global  properties  such  u  closure  of  bord¬ 
ers  A  connected  component  analysis  is  done  in  order  to  perform 
this  task  which  is  described  below. 

First,  the  borders  around  the  potnu  labeled  as  inunor  by  the 
module  1C  are  identified.  This  is  done  by  identifying  thou 
Delaunay  edges  u  borders  that  have  both  endpoints  nonin  tenor  and 
the  common  neighbors  of  whaae  endpoints  locaud  on  the  two  odes 
of  the  edge,  have  different  labels  This  reaulu  in  border  segmenu 
that  surround  the  inunor  regions  Then,  the  inunction  of  these 
identifications  and  the  reaulu  of  the  module  BC  a  uken.  This 
resulu  in  thorn  Delaunay  edges  being  identified  as  border  that  have 
confirmation  from  two  independent  procesms  The  result  is  a  set  of 
border  segmenu  and  a  set  of  inunor  potnu  next  to  them.  Each  of 
these  border  segmenu  is  given  a  label  (eg.  they  art  numbered  L  The 
inunor  regions  then  are  assigned  the  labels  of  til  the  border 
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the  prnra  attempt*  to  extend  it  with  the  eventual  goal  of  cku| 
it  and  tt  the  mat  unt.  ea*uru>|  that  the  border  mgmtnt  being 
extended  is  saomh.  The  resulting  forks  and  dangling  border  mg- 
ments  are  cleaned  If  there  still  remain  border  aqments  around  a 
region  that  are  not  chad  they  art  extended  as  smoothly  at  poable 
*>  that  tome  of  these  Mgments  will  either  merge  with  each  ocher  to 
form  longer  border  segments  to  be  further  processed  or  they  will 
become  chad  thus  ending  the  proceang  of  thst  region.  While 
combining  the  reeults  of  the  correction  ttep  (sup  B  in  figure  IX  one 
must  be  careful  in  handling  the  regions  which  are  bar-like  (i*.  two 
teg  menu  of  parallel  borders  with  no  intenor  region  between  them). 


segments  that  mrround  them.  That  m.  a  point  f  »  aagned  the 
label  of  o  border  ssgment  B,  if  there  exists  •  pith  ftf} '  ■  ft  such 
***•*  hmP .  Pi  a  on  the  border  osgment and  all  the  potnu 
P  if  i  f t  art  labelled  interior.  The  result  a  that  all  the  mte- 
nor  potnu  have  one  or  more  border  segment  labels  aagned  to 
them.  The  goal  a  to  have  all  them  border  mgments  to  form  a  closed 
contour.  \ou  that  the  number  of  final  border  segment  labels 
sagned  to  each  interior  region  may  be  more  than  one  since  a  com¬ 
ponent  may  have  ho  let  in  it. 

The  combination  process  proceeds  with  the  regions  that  have 
only  one  label  aagned  to  them.  If  the  border  a  closed  no  further 
proceang  it  done  on  that  region.  If  th«  border  ia  not  closed  then 


Figure  6  —  The  result  of  interior  identification  (II)  module  run  on 
the  pattern.  The  borders  that  surround  the  identified  interior  re¬ 
gions  are  shown  in  the  figure. 


Figure  9  —  The  remit  of  the  interior  correction  (IC)  module  run  on 
the  remit  in  figure  6  using  information  also  from  figure  7. 


Figure  7  —  The  remit  of  border  identification  (BI)  module  run  on 
the  pattern. 


Figure  10  —  The  result  of  border  correction  (BC)  module  run  on 
the  remit  in  figure  7  using  information  also  from  figure  & 


Figure  S  —  The  result  of  curv  identification  (Cl)  module  run  on  the 
pattern. 


Figure  II  —  The  penial  result  of  combining  the  two  results  in 
figures  9  and  10. 


P 


That  are  important  became  they  might  bt  put  of  a  sack  ia  •  clut¬ 
ter  tad  if  they  tit  dm  cwhamd  tt  due  stage  then  problem*  aha 
in  trying  to  clam  th*  harden  being  extended.  The  problem*  will  be 
due  to  the  fact  that  if  them  border  segments  ait  not  merged  with 
th*  border  eegmeati  of  region*  with  interior  point*  then  there  will 
bt  gap*  in  the  border  of  the  enure  clutter  and  th*  cloeuit  of  it  will 
be  imd  To  avow  this  difficulty  the  border  mgment*  of  them 
regions  with  no  in  tenon  art  merged  with  the  border  mgment*  of 
th*  region*  with  m tenon  if  paaeible.  The  context*  in  which  then 
i*  *  trunnion  from  •  region  with  iatehor*  to  •  region  without  an 
interior  ia  a  clutter  can  occur  are  limited.  Therefore,  thie  contex¬ 
tual  knowledge  along  with  the  criterion  of  border  nonthnam  art 
uaad  when  merging  the  border  mgment*. 

4.  CONCLUSION 

We  have  prom  atari  an  algorithm  for  obtaining  grouping!  in 
dot  pattern*  The  algorithm  work*  bottom  up  and  n  highly  paral¬ 
lel  Scan*  of  the  module*  have  not  bma  completed  and  art 
currently  being  worked  on.  Them  art  the  two  modulm  iatenor- 
boeder-combi nation  UBC)  and  curve  correction  (CC)  ia  ftgurc  1. 
The  algorithm  obtain*  th*  lowoot  level  grouping*  prtmat  in  th*  dot 
pattern.  However,  in  pattern*  which  contain  hierarchical  struc- 
turn*  ia  them,  the  group*  of  dote  obtained  a*  a  (vault  of  th*  mgmea- 
tauoo  at  this  level  can  bt  netted  a*  tokane  to  be  further  grouped 
recur* vely.  Future  plan*  include  extending  th*  algorithm  to  bt 
able  to  obtain  the  hieraichial  structure*  in  *uch  pattarna. 
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ABSTRACT 


A  representation  of  basic  geometrical  properties  of  dots  is  crucial  in  obtaining  perceptual  structure  of  dot  pat¬ 
terns.  This  paper  describes  the  use  of  Voronoi  neighborhoods  and  their  geometrical  properties  to  infer  geometri¬ 
cal  structure  in  dot  patterns.  The  distribution  of  dots  characterizing  different  structural  components  such  as 
curves,  bars,  single-point  dusters,  nonempty  clusters  with  uniform  and  varying  density  interiors  are  studied. 
The  effects  of  dot  distribution  in  each  of  these  components  on  the  geometrical  properties  of  the  Voronoi  neigh¬ 
borhood  of  a  dot  are  described. 

1.  INTRODUCTION 

This  paper  concerns  representation  of  geometric  structure  in  dot  patterns.  Since  the  perceived  structure  in 
a  dot  pattern  is  completely  determined  by  the  relative  spatial  locations  of  dots,  a  definition  of  “neighbors”  of  a 
dot  and  the  “neighborhood”  around  a  dot  is  crucial  in  processing  the  dot  patterns.  In  [l]  we  discussed  the  impor¬ 
tance  of  the  notion  of  the  neighborhood  of  a  dot,  and  specifically,  the  possible  use  of  the  Voronoi  neighborhood 
in  a  variety  of  applications.  In  this  paper,  we  will  describe  in  detail  some  of  the  geometric  properties  of  the 
Voronoi  neighborhoods  that  we  have  used  in  our  research  to  infer  structural  information  in  a  dot  pattern. 

Section  2  reviews  previous  work  on  dot  pattern  processing  and  definitions  of  neighbors  of  a  dot.  Section  3 
reviews  the  definition  of  Voronoi  tessellation  and  Voronoi  neighborhood.  Section  4  describes  in  detail  the 
geometrical  properties  that  can  be  used  to  infer  structural  information  m  dot  patterns.  Many  of  these  proper¬ 
ties  have  already  been  used  in  our  programs  for  perceptual  segmentation  of  dot  patterns.  Finally,  Secuon  5 
presents  concluding  remarks. 

2.  REVIEW  OF  PAST  WORK  * 


A  major  part  of  the  past  work  on  defining  the  neighborhood  of  a  point  has  been  concerned  mainly  with 
the  following  question:  given  an  arbitrary  point  in  a  dot  pattern,  which  other  points  should  be  treated  as  its 
neighbors?  The  definitions  used  in  the  past  have  included  all  the  points  covered  by  a  circular  neighborhood 
with  a  globally  defined  radius  R  [4],  k -nearest  neighbors  of  a  dot  [12],  minimal  spanning  trees  [ll],  relative 
neighborhood  graphs  [?.  9],  and  Gabnel  graphs  [8>  In  all  of  these,  the  geometrical  information  used  pertains  to 
pairs  of  dots  and  is  one  dimensional  in  nature  except  for  the  circular  neighborhood  which  has  the  disadvantage 
of  being  insensitive  to  data.  Minimal  spanning  trees  are  global  m  nature  and  a  small  change  in  one  pan  may 
result  in  drastic  changes  in  parts  of  the  graph  that  are  far  away.  O’Callaghan  defines  a  more  intuitive 
definition  of  a  neighborhood.  He  uses  two  thresholds,  T and  Tr .  to  decide  whether  two  points  P  and  P  are 
neighbors.  If  Pnnr  is  the  nearest  neighbor  of  P  then  P  is  a  neighbor  of  P  if  a)  the  distance  ratio 
dCp.J*  )/d  ( P  J>nfQ,  )  is  not  greater  than  T,  and  b)  for  any  neighbor  P.  of  P  the  angle  P  Pt  P  is  different 
than  180  degrees  by  more  than  T„  (ue.  P  is  not  behind  any  neighbor  P.  of  P  .  In  [l  L  Ahuja  examined  the 
use  of  the  neighborhood  of  a  poun  which  associates  with  a  punt  not  only  otner  points  as  its  neighbors,  but  also 
a  pan  of  the  Euclidean  plane  around  it,  thus,  giving  the  problem  a  two-dimensional  character.  He  closely 
examined  one  specific  definition  of  neighborhood  called  the  Voronoi  neighborhood,  which  is  based  upon  the 
Voronoi  tesKllation  defined  by  a  set  of  points. 

/  I  i  '  ■  -  > 


3.  VORONOI  NEIGHBORHOODS 


3.1.  Voronoi  Tessellation 

Suppose  that  we  are  given  a  set  S  of  three  or  more  points  in  the  Euclidean  plane.  Assume  that  these  points 
are  not  all  cohnear.  and  that  no  four  points  are  cocircular.  Consider  an  arbitrary  pair  of  points  P  and  Q .  The 
bisector  of  the  line  joining  P  and  Q  is  the  locus  of  points  equidistant  from  both  P  and  Q  and  divides  the 
plane  into  two  halves.  The  half  plane  HflHf  is  the  locus  of  points  closer  to  P  {Q  )  than  to  Q  (P ).  For  any 
given  point  P  a  set  of  such  half  planes  is  obtained  for  various  choices  of  Q.  The  intersection  n  & 

Q(SjQ*J> 

defines  a  polygonal  region  consisting  of  points  closer  to  P  than  any  other  point.  Such  a  region  is  called  the 
Voronoi  [10]  polygon  associated  with  the  point.  The  set  of  complete  polygons  is  called  the  Voronoi  diagram  of 
S  [5i  The  Voronoi  diagram  together  with  the  incomplete  polygons  in  the  convex  hull  define  a  Voronoi  tessel¬ 
lation  of  the  entire  plane.  The  Voronoi  tessellation  for  an  example  pattern  is  shown  in  figure  1.  Two  points  are 
said  to  be  Voronoi  neighbors  if  the  Voronoi  polygons  enclosing  them  share  a  common  edge.  The  dual  represen¬ 
tation  of  the  Voronoi  tessellation  is  the  Delaunay  graph  which  is  obtained  by  connecting  all  the  pain  of  points 
which  are  Voronoi  neighbors  as  defined  above. 

3.2.  Neighborhood  of  a  Point 

We  will  consider  as  the  neighborhood  of  a  point  P  (the  region  enclosed  by)  the  Voronoi  polygon  contain¬ 
ing  P .  Considering  the  way  a  Voronoi  polygon  is  constructed,  this  is  an  intuitively  appealing  approach.  The 
local  environment  of  a  point  in  a  given  pattern  is  reflected  in  the  geometrical  characteristics  of  its  Voronoi 
polygon.  This  presents  a  convenient  way  to  compare  the  local  environments  of  different  points.  Since  the  per¬ 
ceived  structure  in  a  dot  pattern  results  from  the  relative  spatial  arrangement  of  points,  the  geometric  proper¬ 
ties  of  Voronoi  polygons  may  be  useful  for  describing  and  detecting  structure  in  dot  patterns.  Such  an 
approach  lends  a  fully  two-dimensional  character  to  the  problem  in  that  the  dot  pattern  is  converted  into  a 
planar  image  or  a  mosaic. 

The  advantages  of  the  Voronoi  neighborhood  compared  to  the  definitions  given  in  the  previous  section  are 
that  the  Voronoi  neighborhood  is  (i)  intuitive,  (ii)  adaptive,  and  (iii)  two-dimensional  in  character.  It  is  adap¬ 
tive  in  the  sense  that  the  assignment  of  neighbors  does  not  depend  on  the  9cale  of  the  dot  pattern  and  neighbors 
are  assigned  to  dots  that  reflect  the  local  density  variations.  Also,  the  number  of  neighbors  of  a  dot  is  not  fixed 
and  may  vary  depending  on  the  structure  in  the  vicinity  of  the  dot. 


4.  GEOMETRIC  PROPERTIES 

It  is  useful  to  look  at  the  possible  structural  patterns  m  a  dot  pattern  and  to  see  how  the  various  possible 
distributions  are  reflected  in  the  geometric  properties  of  the  Voronoi  neighborhoods.  One  type  of  structural 
component  in  a  dot  pattern  is  a  cluster  of  dots  with  nonempty  intenor.  These  types  of  clusters  may  have  an 
intenor  having  either  a  uniform  density  or  a  varying  density.  Another  component  is  a  cluster  with  no  interior, 
or  a  bar.  Besides  these  there  are  the  curvilinear  structures  and  single-point  clusters.  All  of  these  and  their  spa¬ 
tial  configurations  are  reflected  in  the  shapes  of  the  Voronoi  neighborhoods  or  properties  of  the  Delaunay  edges. 

The  Voronoi  neighborhoods  of  the  points  which  reside  within  the  interior  of  a  homogeneous  cluster  will 
have  similar  shapes  ana  sizes.  For  different  clusters,  these  interior  polygons  may  differ  in  their  geometrical  pro¬ 
perties.  The  border  cells  of  a  cluster  will  be  open  if  there  is  no  other  duster  to  bound  them.  The  cells  of  the 
border  points  of  a  cluster  that  have  neighbors  m  a  nearby  cluster  will  differ  from  interior  cells.  For  example, 
they  may  be  elongated  if  the  distance  between  cross  cluster  neighbors  is  larger  than  within  cluster  neighbors,  or 
the  nucleus  of  the  cell  may  be  located  well  off  its  center.  Clearly,  a  globular  cluster  will  have  a  larger  number 
of  interior  cells  than  will  a  more  elongated  cluster.  For  dot  patterns  containing  varying  density  dusters,  the 
interior  cells  will  be  compressed  in  the  direction  of  increasing  density.  This  results  in  the  dots  being  off  the 
center  of  the  cell  in  the  direction  of  increasing  density.  Certain  border  cells  wili  assume  wedge-like  shapes 
where  borders  of  two  dusters  gradually  approach  each  other.  This  is  caused  bv  the  uneven  distribution  of  the 
neighbors  of  a  point.  Such  properties  will  be  further  described  in  detail  in  the  next  section. 

Others  have  suggested  in  the  past  the  use  of  certain  properties  of  the  Voronoi  polygons  for  use  in  dot  pat¬ 
tern  processing.  Sibson  (6]  has  suggested  the  use  of  the  areas  and  nucleus- vertex  distances  of  the  Voronoi 
polygons,  and  the  distances  betw’een  neighboring  points  as  statistics  of  a  point  pattern.  Chapman  [2]  uses  the 
distribution  of  the  areas  of  the  Voronoi  polygons  to  infer  the  structure  of  dot  patterns  describing  geographic 
concentrations  of  economic  activity.  He  relates  the  degree  of  the  local  clustering,  or  nonrandomness,  to  an 
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describe  each  of  the  geometric  properties  in  detail  and  their  computation.  The  terms  polygon  and  neighborhood 
which  is  the  two-dimensional  area  surrounded  by  the  Voronoi  polygon  will  be  used  interchangeably. 

The  first  property  is  the  area  of  a  Voronoi  polygon  of  a  dot.  This  is  a  measure  reflecting  information 
about  the  dot  density  in  the  local  neighborhood  of  a  dot.  In  the  interiors  of  homogeneous  clusters,  the  density 
does  not  change.  Recalling  the  way  the  Voronoi  tessellation  is  constructed,  we  observe  that  this  uniformity  of 
density  will  result  in  the  Voronoi  neighborhood  areas  being  uniform  in  the  interior  regions. 

The  second  property  is  the  eccentricity  of  the  Voronoi  polygons.  This  measure  is  a  scaled  vector  indicating 
how  much  a  dot  is  off  the  center  of  gravity  of  its  Voronoi  polygon.  The  situation  and  the  computation  of  the 
eccentricity  is  shown  in  figure  2.  The  significance  of  the  eccentricity  measure  is  that  it  is  related  to  the  change 
of  density  of  dots.  The  interiors  of  uniform  clusters  are  expected  to  have  cells  with  very  low  eccentricities 
because  of  the  lack  of  variation  in  the  density.  The  interiors  of  varying  density  clusters  will  have  cells  with 
high  eccentricities  due  to  the  density  variation;  the  directions  of  the  eccentricities  will  be  pointing  towards  the 
increasing  density  direction.  Thus,  the  eccentricity  vectors  of  the  cells  in  the  interiors  of  varying  density  clus¬ 
ters  will  be  aligned  most  of  the  time.  At  the  borders  of  clusters,  the  eccentricity  directions  in  most  cases,  will 
be  expected  to  point  towards  the  interiors  of  the  clusters  because  of  the  sudden  increase  in  the  dot  density;  la, 
from  the  very  low  density  in  the  intercluster  space  to  the  comparatively  high  density  in  the  interior  of  the 
cluster.  This  observation  also  holds  on  the  borders  of  bars  which  are  clusters  without  interior  points. 

The  third  property  is  Gabriel  measure,  whose  computation  is  shown  in  figure  3.  It  measures  the  “neigh¬ 
bor  Uness"  of  two  Voronoi  neighbors.  If  the  line  Joining  two  Voronoi  neighbors  i  and  j  intersects  the  edge 
shared  by  the  corresponding  Voronoi  polygons  then  i  and  j  are  perfect  neighbors.  That  is,  there  is  no  third 
point  k ,  such  that  the  point  t  is  hidden  from  the  point  j  by  the  point  k  ,  and  vice  vena.  If,  on  the  other  hand, 
there  is  such  a  third  point  k .  and  the  line  (i  ,j  )  crosses  the  Voronoi  cell  for  point  k ,  then  i  is  hidden  from  j  by 
k  and  the  Gabriel  measure  indicates  the  amount  by  which  this  is  true.  The  deeper  the  line  (t  ,j )  crosses  cell  k , 
the  worse  neighbors  (i  ,j  )  are  and  the  lower  the  Gabriel  measure  is.  This  is  important  on  the  borders  of  clus¬ 
ters,  where  if  the  two  points  are  not  perfect  neighbon  and  have  a  low  Gabriel  measure,  then  the  border  follows 
through  the  intervening  point  instead  of  the  two  points.  For  example,  in  figure  3  if  Gabriel  measure  is  low 
enough,  the  border  passes  through  points  U ,;  Jc )  instead  of  going  through  U .  /  >  directly. 

The  fourth  property  computed  is  the  compactness  of  the  Voronoi  cells.  In  the  interiors  of  clusters,  even 
though  the  density  of  points  may  vary,  the  points  are  surrounded  uniformlv  by  other  points  all  around.  This 
results  in  the  interior  angles  of  the  Voronoi  polygons  of  such  points  being  uniform.  Such  cells  are  called  “com¬ 
pact."  When  the  borders  of  two  clusters  gradually  approach  each  other,  the  cluster  extenor  sides  of  such  borders 
have  a  nonuniform  distribution  of  dots.  The  cluster  intenor  sides  of  such  borders,  however,  have  a  uniform 
distribution  of  dots.  This  results  in  the  dot  distribution  around  a  point  lvmg  on  such  a  border  segment  to  be 
uneven  which,  in  turn,  is  reflected  in  the  shape  of  the  Voronoi  polygon  of  the  dot.  An  example  of  such  a  case  is 
the  point  A  and  its  Voronoi  neighborhood  in  figure  1.  Such  a  polygon  has  a  wedge- like  shape,  and  is  “non¬ 
compact."  The  computation  of  the  compactness  measure  is  shown  in  figure  4. 
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Figure  1  —  The  Voronoi  tessellation  of  an  ex- 


Figure  2  —  Eccentricity  of  a  cell  belonging  to 
point  P  is  defined  as  d  iD .  Eccentricity  direc¬ 
tion  is  in  the  direction  of  QP .  Here  Q  is  the 

T r*  r>f  Jfh«s  ^  ..  „  r  m-  ^  + 


/  -S.’  v'  V 


,  H. 


,  i'a  I*. 


»»t_  »!»>>»  ♦.«  t,1 


■I  M  I.H  l  l  l  iM 


Another  property  of  the  Yoronoi  cells  is  their  elongation  and  the  direction  of  their  minor  or  major  axis 
Hus  measure  gains  importance  in  clusters  which  have  uniform  distribution  of  dots  but  the  density  is  direction 
sensitive.  That  is.  the  dot  density  along  a  given  direction  is  different  than  that  along  another  direction.  In  such 
$*<m,  the  Voronoi  polygons  tend  to  be  more  squeezed  along  the  higher  density  direction  than  along  lower  den¬ 
sity  direction,  thus,  resulting  in  a  more  elongated  cell  The  major  and  minor  axes  directions  of  such  cells  indi¬ 
cate  the  directions  along  which  the  dot  densities  are  smallest  and  greatest,  respectively.  The  cells  along  a  curve 
will  also  tend  to  be  elongated  (as  illustrated  by  point  B  in  figure  1)  due  to  the  fact  that  on  the  two  sides  of  the 
curve  the  dot  density  is  very  low  compared  to  the  dot  density  along  the  curve.  Thus,  such  elongated  cells  are 
one  of  the  indications  of  the  existence  of  curvilinear  structures. 

There  are  many  ways  the  elongation  of  a  polygon  can  be  computed.  One  possibility  is  the  ratio  of  the 
area  of  the  polygon  to  its  perimeter  squared.  Another,  which  we  have  used,  uses  the  information  from  the 
computation  of  moments  of  area  [3]  to  obtain  both  the  amount  of  elongation  and  the  directions  of  the  major 
and  minor  axes.  The  computation  is  as  follows: 
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Here  the  fi,  ,s  are  the  second  order  moments  of  area  that  are  scale  and  translation  invariant:  elong  is  the 
amount  of  elongation  of  the  cell  and  a  is  the  angle  that  the  major  of  the  cell  makes  with  the  x-axis.  The 
elongation  measure  itself  is  rotation  invariant. 

So  far  all  of  the  properties  discusKd  were  two-dimensional  properties  of  the  Voronoi  polygons.  Most  of 
these  properties  make  sense  when  used  for  clusters  that  have  interiors.  For  curves  or  single-point  clusters  the 
two-dimensional  properties  are  no  longer  well  behaved.  For  example,  the  area  differences  are  not  meaningful 
when  used  in  regions  with  curvilinear  structures,  or  on  borders  of  clusters.  In  such  regions  one  dimensional 
measures  such  as  distances,  etc,  are  more  useful.  In  the  following  paragraphs,  we  will  describe  several  such 
properties. 

The  first  such  property  is  a  measure  based  on  the  differences  in  the  length  of  a  Delaunay  edge  and  the 
average  distances  of  its  endpoints  to  their  Voronoi  neighbors.  The  computation  of  this  property  is  shown  in 
figure  5.  In  the  intercluster  space  the  Delaunay  edges  have  endpoints  on  the  borders  of  clusters,  on  single-point 
clusters,  or  on  curves.  If  one  of  the  endpoints  is  on  the  border  of  a  cluster  then  the  distances  on  the  interior  of 
that  cluster  will  have  relatively  small  distances  compared  to  the  distance  m  the  intercluster  space.  Thus  at 
least  one  side  of  a  Delaunay  edge  having  an  average  distance  which  is  small  compared  to  the  length  of  that 
Delaunay  edge  is  an  indication  that  the  edge  is  most  probably  in  the  mtercluster  space.  In  this  case  the  measure 
will  be  high  indicating  this  high  probability. 

.Another  measure,  “squeezedness."  is  computed  which  is  very  closely  related  to  the  elongation,  but  it  is  a 
property  of  the  Delaunay  edges  rather  than  Voronoi  polygons,  and  it  is  based  upon  the  distances  of  the 


Figure  3  —  The  Gabriel  measure  for  the  De¬ 
launay  edge  gabr.  ID  if  the  line 
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Figure  4  —  Compactness  measure  is  computed 
in  terms  of  the  angles  a,  .  Let 
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surrounding  Delaunay  edges.  Figure  6  shows  its  computation.  This  measure  is  also  mostly  useful  for  curvi¬ 
linear  clusters.  Namely,  the  Delaunay  edges  that  lie  on  a  curvilinear  cluster  are  expected  to  be  squeezed  com¬ 
pared  to  the  Delaunay  edges  extending  on  the  two  sides  of  the  curve  laterally.  If  this  is  the  case,  then  the 
squeezedness  measure  will  be  high,  indicating  the  possibility  of  the  Delaunay  edge  being  on  a  curve. 

All  of  the  properties  described  above  have  been  used  in  an  algorithm  that  we  are  developing  for  obtaining 
perceptual  segmentation  of  dot  patterns.  The  segmentation  algorithm  consists  of  three  phases:  (l)  identification 
of  different  types  of  structures  in  the  pattern,  namely  interiors  of  clusters,  borders  of  clusters,  bars,  and  curves: 
(2)  correction  of  the  erroneous  results  of  the  first  phase  which  are  a  result  of  local  ambiguities;  (3)  combining 
these  results  to  obtain  a  unified  segmentation.  The  Yoronoi  neighborhood  properties  were  used  in  the  modules 
of  the  first  phase  for  obtaining  the  four  different  types  of  structures.  These  modules  are  formulated  as  proba¬ 
bilistic  relaxation  labeling  schemes.  The  Voronoi  neighborhood  properties  described  above  were  used  m  deriv¬ 
ing  the  expressions  for  the  compatibility  coefficients  of  these  modules  that  are  necessary  for  this  formulation. 

The  correction  module  takes  these  results  which  might  have  wrong  identifications  in  them  because  of  the 
insufficiency  of  local  evidence,  and  tries  to  eliminate  the  errors  by  integrating  more  global  information  from 
multiple  sources  (modules).  It  enforces  such  requirements  as  border  smoothness  and  a  high  degree  of  agreement 
between  the  results  of  the  independent  modules.  This  is  also  formulated  as  a  probabilistic  relaxation  scheme. 

The  corrected  results  of  this  phase  is  fed  into  the  combination  phase  which  combines  the  outputs  to  obtain 
a  unified  segmentation.  The  combination  starts  with  the  interior  regions  of  the  clusters  and  looks  only  at  the 
border  segments  adjacent  to  these  interior  regions.  If  there  are  any  incomplete  borders,  it  extends  these  borders 
and  tries  to  combine  them  with  other  border  segments  such  that  the  resulting  closed  border  is  the  smoothest. 
The  eventual  goal  is  to  have  all  the  borders  around  interior  regions  to  be  closed,  smooth  curves. 

.After  this  step  it  is  possible  to  regard  the  groups  of  clusters  obtained  in  this  fashion  as  tokens  —  or  dots  — 
to  be  further  grouped.  In  this  manner  it  is  possible  to  obtain  a  hierarchy  of  grouping  at  different  levels  of  reso¬ 
lution. 

5.  CONCLUSION 

Analysis  of  dot  patterns  requires  a  sound  notion  of  the  local  environment  of  a  point.  We  have  used  the 
Yoronoi  neighborhoods  of  points  to  characterize  the  local  structure  because  of  the  many  intuitively  appealing 
properties  of  such  neighborhoods  [l].  We  have  described  various  geometric  properties  of  the  Yoronoi  polygons 
and  the  Yoronoi  tessellation  that  provide  useful  information  about  the  geometric  structure  of  the  dot  patterns. 
We  have  used  these  properties  in  our  research  in  designing  a  unified  segmentation  algorithm  for  processing 
unrestricted  dot  patterns.  The  results  we  have  obtained  have  shown  that  the  Yoronoi  tessellation  and  the 
geometric  properties  of  the  Yoronoi  polygons  described  in  this  paper  can  be  used  successfully  to  infer  informa¬ 
tion  about  the  geometric  structure  of  dot  patterns. 


Figure  5  —  The  distance  measure  for  the  De¬ 
launay  edge  (i .  j  ),  dist, , .  is  defined  in  terms  of 
the  length  of  the  Delaunay  edge  ( i,j  ),  d ,  and 
the  average  Delaunay  edge  lengths  on  its  two 
endpoints.  dav,  and  dav,.  Let 
D  •min  (dav,  4av ; ).  Then  disitJ»\—D  Id  if 
d  >D .  and  dist  .  «0  otherwise. 


Figure  6  —  Squeezecness  measure,  sa  .  is 
defined  in  terms  of  the  length  of  the  Delaunav 
edge  (i  ,j  ).  d.  and  the  average  Delaunay  edge 
lengths  on  its  two  sides  laterally.  da\‘  |  and 
dav  y  Let  D  •rmn(dav  l¥dav  2).  Then 
D  if  d  <D.  and  sq,  *0  otherwise. 
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